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Application/Control Number: 10/610,492 Page 2 

Art Unit: 2166 

DETAILED ACTION 

1 . This action is in response to amendments, arguments, and remarks filed on 
October 17, 2007, in which claims 1-17, 19-32, 34-42, & 44-47 are presented for 
further examination. 

2. Claim 1 has been amended. 

3. Claims 18, 33, & 43 have been cancelled from prior prosecution. 

4. Claims 1-17, 19-32, 34-42, & 44-47 are pending. 

Response to Arguments 

5. Applicant's arguments with respect to claims 1 -1 7, 1 9-32, 34-42, & 44-47 have 
been considered but are moot in view of the new ground(s) of rejection. See 
Action below. 
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Claim Rejections - 35 USC § 103 

6. The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

7. Claims 1 -1 2, 1 4-1 7, 1 9-28, 30-32, 34-42, & 44-47 are rejected under 35 
U.S.C. 1 03(a) as being unpatentable over "SMIL 2.0 XML for Web Multimedia", 
hereinafter referred to as SMIL, in view of Kobayashi et al. (US Patent No. 
6,473,096 B1), hereinafter referred to Kobayashi. 

In respect to Claim 1 , SMIL teaches: 

a method performed by a computer comprising: referencing 
one or more multimedia objects through a first set of one or 
more elements (SMIL discloses (pg. 79, heading "Media Content") 
referencing of multimedia objects, also disclosed are elements video, 
audio and text.) 

SMIL does not explicitly disclose: 

referencing at least a portion of the first set of one or more 
elements to one or more elements in a second set of one or 
more elements 

arranging the second set of one or more elements to indicate 
timing for the multimedia objects referenced by the first set of 
one or more elements 

However, Kobayashi teaches: 
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referencing at least a portion of the first set of one or more 
elements to one or more elements in a second set of one or 
more elements (Kobayashi teaches (FIG. 7, column 12, lines 6-62) 
a scenario wherein elements from history information is referenced 
by a second set of elements.) 

arranging the second set of one or more elements to indicate 
timing for the multimedia objects referenced by the first set of 
one or more elements (Kobayashi teaches (column 12, lines 6-62) 
timing element <sequential> for multimedia objects.) 
It would have been obvious to one of ordinary skill in the art at the 
time of the invention to utilize the teachings of Kobayashi into the 
system of SMIL. One of ordinary skill in the art would be motivated 
to provide a system of referencing elements to allow authors to adapt 
and change multimedia content for different market groups, users, or 
consumers.) 

As per Claim 2, SMIL teaches: 

the referencing is performed by pointers in the first set of one or 
more elements that point to the multimedia objects (SMIL 
discloses (pg. 79, heading "Media Content") referencing of objects 
through elements, wherein it is apparent that this referencing must be 
accomplished by pointers.) 

As per Claim 3, SMIL teaches: 
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the referencing and associating are performed by the same 
document (SMIL discloses (pg. 81, heading "Temporal composites") 
referencing of objects with seq element in which these objects are 
associated by the same document.) 

As per Claim 4, SMIL teaches: 

the arranging is performed through a time container that defines 
the second set of one or more elements (SMIL discloses (pg. 81 , 
heading "Temporal composites") a seq and par element, which are 
timing elements, wherein these timing elements are time containers.) 

As per Claim 5, SMIL teaches: 

the time container is defined by SMIL conventions (pg. 81 , 
heading "Temporal composites") 

As per Claim 6, SMIL teaches: 

the time container defines that the elements of the second set of 
one or more elements are rendered at the same time (SMIL 
discloses (pg. 81, heading "Temporal composites") the par element 
specifying elements starting at the same time, wherein the time 
container specifies timing arrangements.) 

As per Claim 7, SMIL teaches: 

the time container defines that the elements of the second set of 
one or more elements are rendered one after another in an 
ordered list (SMIL discloses (pg. 81, heading "Temporal 
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composites") the seq element specifying elements be played 
sequentially or "one after another".) 

As per Claim 8, SMIL teaches: 

the time container defines that the elements of the second set of 
one or more elements are rendered exclusive of one another 
(SMIL discloses (pg. 82, heading "Linking") the excl element, wherein 
elements are rendered exclusive of one another.) 

As per Claim 9, SMIL teaches: 

rendering of the multimedia objects based on the arranging of 
the second set of one or more elements (SMIL discloses (pg. 81 , 
heading "Temporal composites") that the seq element is a timing 
elements, further disclosed is that the seq element indicates that its 
children play in sequence. Objects are played based on the 
arrangement of elements.) 

As per Claim 10, SMIL teaches: 

associating the second set of one or more elements with a third 
set of one or more elements (SMIL discloses (pg. 81 , heading 
"Temporal composites") the seq element, which associates with child 
seq elements. The parent element and child element are indicative 
of multiple sets of one or more elements, which are associated 
through parent/child relationships.) 

As per Claim 1 1 , SMIL does not explicitly disclose: 
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the referencing is performed by a first document and the 
associating is performed by a second document 

However, Kobayashi teaches: 

the referencing is performed by a first document and the 
associating is performed by a second document (Kobayashi 
teaches (FIG. 7, column 12, lines 6-62) referencing and associating 
in multiple documents.) 

Therefore, the limitations of claim 1 1 are rejected in the analysis of 
claim 1 above, and the claim is rejected on that basis. 

As per Claim 12, SMIL teaches: 

documents written in XML (SMIL discloses (pg. 78, column 2, pg. 
81 , column 1 ) use of XML to write documents.) 

SMIL does not explicitly disclose: 

first and second documents 

However, Kobayashi teaches: 

first and second documents (column 12, lines 6-62) 

Therefore, the limitations of claim 12 are rejected in the analysis of 

claim 1 1 above, and the claim is rejected on that basis. 

As per Claim 14, SMIL discloses: 

receiving an input to initiate an event affecting an element in the 
first set of one or more elements and providing a proxy element 
in the second set of elements that is configured to reference 
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application of the event (SMIL discloses (pg. 79, heading "Media 
Content") referencing of multimedia objects, also disclosed are 
elements video, audio and text.) 

As per Claim 15, SMIL discloses: 

the arranging is performed through a time container that defines 
the second set of one or more elements (SMIL discloses (pg. 81 , 
heading "Temporal composites") a seq and par element, which are 
timing elements, wherein these timing elements are time containers.) 

As per Claim 16, SMIL discloses: 

the time container is defined by SMIL conventions (SMIL 
discloses (pg. 81 , headings "Temporal composites" & "Timing 
attributes" time containers defined by SMIL conventions.) 

As per Claim 17, SMIL discloses: 

a multimedia device that performs the method of claim 1 (FIG. 1 
illustrates a device for performing the methods of SMIL.) 

In respect to Claim 19, SMIL discloses: 

a method performed by a computer comprising: referencing 
one or more multimedia objects through a first set of one or 
more elements in a first document (SMIL discloses (pg. 79, 
heading "Media Content") referencing of multimedia objects, also 
disclosed are elements video, audio and text.) 

SMIL does not explicitly disclose: 
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associating the first set of one or more elements in the first 
document to a second set of one or more elements in a second 
document 

arranging the second set of one or more dements of the second 
document to indicate timing for the multimedia objects 
referenced by the first set of one or more elements in the first 
document 

However, Kobayashi teaches: 

associating the first set of one or more elements in the first 
document to a second set of one or more elements in a second 
document (Kobayashi teaches (FIG. 7, column 12, lines 6-62) a 
scenario wherein elements from history information is referenced by 
a second set of elements.) 

arranging the second set of one or more dements of the second 
document to indicate timing for the multimedia objects 
referenced by the first set of one or more elements in the first 
document (Kobayashi teaches (column 12, lines 662) timing 
element <sequential> for multimedia objects.) 
It would have been obvious to one of ordinary skill in the art at the 
time of the invention to utilize the teachings of Kobayashi into the 
system of SMIL. One of ordinary skill in the art would be motivated 
to provide a system of referencing elements to allow authors to adapt 
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and change multimedia content for different market groups, users, or 
consumers.) 

As per Claim 20, SMIL discloses: 

the referencing is performed by pointers in the first set of one or 
more elements in the first document that point to the one or 
more multimedia objects (SMIL discloses (pg. 79, heading "Media 
Content") referencing of objects through elements, wherein it is 
apparent that this referencing must be accomplished by pointers.) 

As per Claim 21 , SMIL discloses: 

the arranging is performed through a time container that defines 
the second set of one or more elements (SMIL discloses (pg. 81 , 
heading "Temporal composites") a seq and par element, which are 
timing elements, wherein these timing elements are time containers.) 

As per Claim 22, SMIL discloses: 

the time container is defined by SMIL conventions (pg. 81 , 
heading "Temporal composites") 

As per Claim 23, SMIL discloses: 

the time container defines that the elements of the second set of 
one or more elements are rendered at the same time (SMIL 
discloses (pg. 81 , heading "Temporal composites") the par element 
specifying elements starting at the same time, wherein the time 
container specifies timing arrangements.) 
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As per Claim 24, 



SMIL discloses: 



the time container defines that the elements of the second set of 
one or more elements are rendered one after another in an 
ordered list (SMIL discloses (pg. 81, heading "Temporal 
composites") the seq element specifying elements be played 
sequentially or "one after another".) 



the time container defines that the elements of the second set of 
one or more elements are rendered exclusive of one another 

(SMIL discloses (pg. 82, heading "Linking") the excl element, wherein 
elements are rendered exclusive of one another.) 



associating the second set of one or more elements in the 
second document to a third set of one or more elements in a 
third document 



associating the second set of one or more elements in the 
second document to a third set of one or more elements in a 
third document (column 12, lines 6-62, FIG. 7, FIG. 20) 
Therefore, the limitations of claim 26 are rejected in the analysis of 
claim 19 above, and the claim is rejected on that basis. 



As per Claim 25, 



SMIL discloses: 



As per Claim 26, 



SMIL does not explicitly disclose: 



However, Kobayashi teaches: 



As per Claim 27, SMIL discloses: 
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documents are written in XML (SMIL discloses (pg. 78, column 2, 
pg. 81 , column 1 ) use of XML to write documents.) 

SMIL does not explicitly disclose: 

first, second, and third documents 

However, Kobayashi teaches: 

first, second, and third documents (FIGs. 4, 5, & 7-10) 
Therefore, the limitations of claim 27 are rejected in the analysis of 
claim 26 above, and the claim is rejected on that basis. 

As per Claim 28, SMIL discloses: 

documents are written in XML (SMIL discloses (pg. 78, column 2, 
pg. 81 , column 1 ) use of XML to write documents.) 

SMIL does not explicitly disclose: 

first and second documents 

However, Kobayashi teaches: 

first and second documents (FIGs. 4, 5, & 7-10) 

Therefore, the limitations of claim 28 are rejected in the analysis of 

claim 19 above, and the claim is rejected on that basis. 



As per Claim 30, SMIL discloses: 

receiving an input to initiate an event affecting an element in the 
first set of one or more elements of the first document and 
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providing a proxy element in the second document that is 
configured to reference initiation of the event (SMIL discloses 
(pg. 79, heading "Media Content") referencing of multimedia objects, 
also disclosed are elements video, audio and text.) 



the arranging is performed through a time container that defines 
the second set of one or more elements in the second document 

(SMIL discloses (pg. 81, heading "Temporal composites") a seq and 
par element, which are timing elements, wherein these timing 
elements are time containers.) 



a multimedia device that performs the method of claim 19 (FIG. 
1 illustrates a device for performing the methods of SMIL.) 



a multimedia device comprising: a processor; and instructions 
stored in a memory and executable on the processor configured 
to associate (SMIL discloses (pg. 79, heading "Media Content") 
referencing of multimedia objects, also disclosed are elements video, 
audio and text.) 



As per Claim 31 



SMIL discloses: 



As per Claim 32, 



SMIL discloses: 



In respect to Claim 34, SMIL teaches: 



SMIL does not explicitly disclose: 
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a first document with a second document through a first set of 
elements in the first document and a second set of elements in 
the second document 

wherein the first set of elements reference multimedia objects 
and the second set of elements are arranged to provide a 
rendition timing for the multimedia objects 

However, Kobayashi teaches: 

a multimedia device comprising: a processor; and 
instructions stored in a memory and executable on the 
processor configured to associate a first document with a 
second document through a first set of elements in the first 
document and a second set of elements in the second 
document (Kobayashi teaches (FIG. 7, column 12, lines 6-62) a 
scenario wherein elements from history information is referenced by 
a second set of elements.) 

wherein the first set of elements reference multimedia objects 
and the second set of elements are arranged to provide a 
rendition timing for the multimedia objects (Kobayashi teaches 
(column 12, lines 662) timing element <sequential> for multimedia 
objects.) 

It would have been obvious to one of ordinary skill in the art at the 
time of the invention to utilize the teachings of Kobayashi into the 
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system of SMIL. One of ordinary skill in the art would be motivated 
to provide a system of referencing elements to allow authors to adapt 
and change multimedia content for different market groups, users, or 
consumers.) 

As per Claim 35, SMIL discloses: 

the rendition timing is a time container (SMIL discloses (pg. 81 , 
heading "Temporal composites") a seq and par element, which are 
timing elements, wherein these timing elements are time containers.) 

As per Claim 36, SMIL discloses: 

the time container is defined by SMIL conventions (SMIL 
discloses (pg. 81 , headings "Temporal composites" & "Timing 
attributes" time containers defined by SMIL conventions.) 

As per Claim 37, SMIL discloses: 

the instructions are further configured to associate a third set of 
elements in a third document with the second set of elements in 
the second document (SMIL discloses (pg. 81, heading "Temporal 
composites") the seq element, which associates with child seq 
elements. The parent element and child element are indicative of 
multiple sets of one or more elements, which are associated through 
parent/child relationships.) 

As per Claim 38, SMIL discloses: 
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the instructions are further configured to receive an event 
initiating input and inform the second document of occurrence 
of the event (SMIL discloses (pg. 79, heading "Media Content") 
referencing of multimedia objects, also disclosed are elements video, 
audio and text.) 

As per Claim 39, SMIL does not explicitly disclose: 

the instructions are further configured to associate the first set 
of elements in the first document with a third set of elements in 
a third document 

However, Kobayashi teaches: 

the instructions are further configured to associate the first set 
of elements in the first document with a third set of elements in 
a third document (FIGs. 4, 5, & 7-10) 

Therefore, the limitations of claim 39 are rejected in the analysis of 
claim 34 above, and the claim is rejected on that basis. 
In respect to Claim 40, SMIL discloses: 

one or more computer-readable media carrying data structures 
comprising: a first content document formatted in a textual 
markup language having tagged elements that reference one or 
more multimedia objects (SMIL discloses (pg. 79, heading "Media 
Content") referencing of multimedia objects, also disclosed are 
elements video, audio and text.) 
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SMIL does not explicitly disclose: 

a timing document formatted in a textual markup language 
having a plurality of tagged elements; at least some of the 
tagged elements of the timing document referencing the 
elements of the first content document; and the tagged 
elements of the timing document specifying rendition timings 
for the multimedia objects referenced by the tagged elements of 
the first content document 

However, Kobayashi teaches: 

a timing document formatted in a textual markup language 
having a plurality of tagged elements; at least some of the 
tagged elements of the timing document referencing the 
elements of the first content document; and the tagged 
elements of the timing document specifying rendition timings 
for the multimedia objects referenced by the tagged elements of 
the first content document (Kobayashi teaches (FIG. 7, column 12, 
lines 6-62) a scenario wherein elements from history information is 
referenced by a second set of elements.) (Kobayashi teaches 
(column 12, lines 662) timing element <sequential> for multimedia 
objects.) 

It would have been obvious to one of ordinary skill in the art at the 
time of the invention to utilize the teachings of Kobayashi into the 
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system of SMIL. One of ordinary skill in the art would be motivated 
to provide a system of referencing elements to allow authors to adapt 
and change multimedia content for different market groups, users, or 
consumers.) 



the rendition timings are defined by time containers (SMIL 
discloses (pg. 81 , heading "Temporal composites") a seq and par 
element, which are timing elements, wherein these timing elements 
are time containers.) 



a second content document formatted in a textual markup 
language having tagged elements that reference the tagged 
elements of the first content document 



a second content document formatted in a textual markup 
language having tagged elements that reference the tagged 
elements of the first content document (FIGs. 4, 5, & 7-10) 
Therefore, the limitations of claim 42 are rejected in the analysis of 
claim 40 above, and the claim is rejected on that basis. 



As per Claim 41 



SMIL discloses: 



As per Claim 42, 



SMIL does not explicitly disclose: 



However, Kobayashi teaches: 



In respect to Claim 44, SMIL discloses: 



Application/Control Number: 1 0/61 0,492 Page 1 9 

Art Unit: 2166 

one or more computer-readable media carrying data structures 
comprising: a first document formatted in a textual markup 
language having a plurality of tagged elements responsive to 
events (SMIL discloses (pg. 79, heading "Media Content") 
referencing of multimedia objects, also disclosed are elements video, 
audio and text.) 

SMIL does not explicitly disclose: 

a second document formatted in a textual markup language 
having a plurality of tagged elements; at least some of the 
tagged elements of the second document referencing the events 
affecting the tagged elements of the first document, wherein the 
tagged elements of the second document specify rendition 
timings for multimedia objects that are referenced by the tagged 
elements of the first document 

However, Kobayashi teaches: 

a second document formatted in a textual markup language 
having a plurality of tagged elements; at least some of the 
tagged elements of the second document referencing the events 
affecting the tagged elements of the first document, wherein the 
tagged elements of the second document specify rendition 
timings for multimedia objects that are referenced by the tagged 
elements of the first document (Kobayashi teaches (FIG. 7, 
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column 12, lines 6-62) a scenario wherein elements from history 
information is referenced by a second set of elements.) (Kobayashi 
teaches (column 12, lines 662) timing element <sequential> for 
multimedia objects.) 

It would have been obvious to one of ordinary skill in the art at the 
time of the invention to utilize the teachings of Kobayashi into the 
system of SMIL. One of ordinary skill in the art would be motivated 
to provide a system of referencing elements to allow authors to adapt 
and change multimedia content for different market groups, users, or 
consumers.) 
In respect to Claim 45, SMIL discloses: 

a system comprising: a broadcast point providing multimedia 
objects; and a multimedia device that receives the multimedia 
objects (FIG. 1 illustrates a device for performing the methods of 
SMIL.) 

SMIL does not explicitly disclose: 

a first document that references the multimedia objects, and 
second document that provides rendition timing for the 
multimedia objects 



However, Kobayashi teaches: 
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a first document that references the multimedia objects, and 
second document that provides rendition timing for the 
multimedia objects (Kobayashi teaches (FIG. 7, column 12, lines 6- 
62) a scenario wherein elements from history information is 
referenced by a second set of elements.) (Kobayashi teaches 
(column 12, lines 662) timing element <sequential> for multimedia 
objects.) 

It would have been obvious to one of ordinary skill in the art at the 
time of the invention to utilize the teachings of Kobayashi into the 
system of SMIL. One of ordinary skill in the art would be motivated 
to provide a system of referencing elements to allow authors to adapt 
and change multimedia content for different market groups, users, or 
consumers. 

As per Claim 46, SMIL does not explicitly disclose: 

the multimedia device further receives an input that initiates an 
event in the first document, and informs the second document 

However, Kobayashi teaches: 

the multimedia device further receives an input that initiates an 
event in the first document, and informs the second document 
(Kobayashi teaches (FIG. 7, column 12, lines 6-62) a scenario 
wherein elements from history information is referenced by a second 
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set of elements.) (Kobayashi teaches (column 1 2, lines 662) timing 
element <sequential> for multimedia objects.) 
Therefore, the limitations of claim 46 are rejected in the analysis of 
claim 45 above, and the claim is rejected on that basis. 
As per Claim 47, SMIL does not explicitly disclose: 

the multimedia device further receives a third document 
referenced by the second document; reading at least a subset of 
audio content comprising an audio file from optical media 
removably integrated with an optical drive; and analyzing at 
least the read subset of audio content to quantify optical drive 
read accuracy; and generating one or more metrics of optical 
drive read accuracy based, at least in part, on the analysis of the 
read subset of audio content (Kobayashi teaches (FIG. 7, column 
12, lines 6-62) a scenario wherein elements from history information 
is referenced by a second set of elements.) (Kobayashi teaches 
(column 12, lines 662) timing element <sequential> for multimedia 
objects.) 

Therefore, the limitations of claim 47 are rejected in the analysis of 
claim 45 above, and the claim is rejected on that basis. 
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8. Claims 13 & 29 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
"SMIL 2.0 XML for Web Multimedia", hereinafter referred to as SMIL, in view of 
Kobayashi et al. (US Patent No. 6,473,096 B1), hereinafter referred to 
Kobayashi, and further in view of "Integrating SMIL Timing into other XML-Based 
Languages", hereinafter referred to as SMIL99. 
As per Claim 13, SMIL & Kobayashi do not explicitly disclose: 

the first document is written in XML, and the second document 
is a style sheet 
However, SMIL99 discloses: 

the first document is written in XML, and the second document 
is a style sheet (SMIL99 discloses (pg. 2, background section) 
documents written in XML and defining by another language XHTML, 
and CSS based style sheet.) 

It would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the method of SMIL99 into the 
method of SMIL. One of ordinary skill in the art would be motivated 
to allow documents to be written in XML and in CSS for increased 
flexibility. 

As per Claim 29, SMIL & Kobayashi do not explicitly disclose: 

the first document is written in XML, and the second document 
is a style sheet 
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However, SMIL99 discloses: 

the first document is written in XML, and the second document 
is a style sheet (SMIL99 discloses (pg. 2, background section) 
documents written in XML and defining by another language XHTML, 
and CSS based style sheet.) 

It would have been obvious to one of ordinary skill in the art at the 
time of the invention to incorporate the method of SMIL99 into the 
method of SMIL. One of ordinary skill in the art would be motivated 
to allow documents to be written in XML and in CSS for increased 
flexibility. 
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Conclusion 

9. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JOSHUA BULLOCK whose telephone number is 
(571)270-1395. The examiner can normally be reached on 7:30am-5pm EST M- 
F. If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, John Breene can be reached on 571-272-4107. The fax 
phone number for the organization where this application or proceeding is 
assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR 
only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 



/J. B. / 

Examiner, Art Unit 2162 

04/11/2008 

/Joon H. Hwang/ 

for John Breene, SPE of Art Unit 2162 



